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Abstract 

Wireless technology enables novel approaches to healthcare, in particular the remote monitoring of 
vital signs and other parameters indicative of people's health. This paper considers a system scenario 
relevant to such applications, where a smart-phone acts as a data-collecting hub, gathering data from a 
number of wireless-capable body sensors, and relaying them to a healthcare provider host through standard 
existing cellular networks. Delay of critical data and sensors' energy efficiency are both relevant and 
conflicting issues. Therefore, it is important to operate the wireless body-area sensor network at some 
desired point close to the optimal energy-delay tradeoff curve. This tradeoff curve is a function of the 
employed physical-layer protocol: in particular, it depends on the multiple-access scheme and on the 
coding and modulation schemes available. In this work, we consider a protocol closely inspired by the 
widely-used Bluetooth standard. First, we consider the calculation of the minimum energy function, 
i.e., the minimum sum energy per symbol that guarantees the stability of aU transmission queues in 
the network. Then, we apply the general theory developed by Neely to develop a dynamic scheduling 
policy that approaches the optimal energy-delay tradeoff for the network at hand. Finally, we examine the 
queue dynamics and propose a novel policy that adaptively switches between connected and disconnected 
(sleeping) modes. We demonstrate that the proposed policy can achieve significant gains in the realistic 
case where the control "NULL" packets necessary to maintain the connection aUve, have a non-zero 
energy cost, and the data arrival statistics corresponding to the sensed physical process are bursty. 
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I. Introduction 

Wireless Body Area Networks (WBAN) allow wireless connectivity among devices operating within 
very close proximity to the human body (see |jT|, Q and references therein). A commonly proposed 
architecture for WBAN considers sensors and/or actuators with limited power and buffering capacity, 
communicating with a body-wearable "local hub" node with significantly larger power, buffering and 
processing capability. The local hub acts as the WBAN controller, data fusion center, and gateway for 
external connectivity. Smartphones are well suited to serve as such hubs because of their large storage 
capacity and processing power. Furthermore, most people already live with one of these phones in their 
pocket almost continuously, and naturally recharge their batteries for reasons that go beyond medical 
monitoring. The connection from the hub to the outside world poses no challenges since it makes use of 
a Wireless Local Area Network (WLAN) or 3G/LTE cellular data connection, either of which is widely 
available and provides more than sufficient data rate for the purpose of health monitoring ||3|. Therefore, 
this paper focuses on the WBAN segment of the system, comprised of the sensors and the local hub. In 
particular, since the local hub has a large battery and it is easily recharged, we focus on the energy-delay 
tradeoff of the communication from sensors to the hub, although the WBAN protocol is bi-directional 
and involves the transmission of control packets also from the hub to the sensors as well. 

The sensing signals of interest for healthcare applications require data rates that range from some tens 
of bit/s to hundreds of kbit/s, as shown in Table |l] (see Q). The "arrival process" modeling the sensing 
operations may range from very impulsive to deterministic. For example, an ElectroEncephaloGraphy 
(EEG) signal triggered by an epileptic seizure may be silent for a long time and then suddenly produce a 
very large amount of data within a short time period. In contrast, an ElectroCardioGraphy (ECG) signal 
for monitoring of physical activity in obese children |[5| produces a steady data rate. 

Given the random, possibly impulsive, nature of the sensor-generated data, the sensor node must be 
equipped with a transmission queue for local buffering. The rate and power allocated by the scheduler 
to the sensor-to-hub link (uplink) must ensure stability of the queue to avoid data loss resulting from 
buffer overflow. On the other hand, the energy efficiency of the sensor nodes is critically important since 
the sensor's battery may not be easily replaced or recharged. Minimum energy expenditure subject to 
queue stability yields the so-called minimum energy function |^6J of the system, defined as the infimum 
of the sum of the sensors' average transmit energy per symbol^ subject to stability of all queues. The 

'in this paper we refer to "energy" to indicate average transmit energy per symbol, which corresponds to the transmit power, 
up to a fixed proportionality factor that depends on the signaling baud rate (symbols per second). 
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transmission delay can be reduced by spending more than the minimum average energy per symbol. 
The problem of optimal energy-delay tradeoff was addressed by Berry and Gallager ||7| for the single- 
user case and significantly extended by Neely [6] to the K > 1 users case. In our case, we remark 
that smartphones have a built-in WBAN capability for short-range communication with other devices, 
currently based on the Bluetooth protocol |j8| (a possible rival protocol, IEEE 802.15.6, is in the process 
of being standardized |9]). Therefore, it is likely that the first generation of such WBAN applications 
will exploit Bluetooth. 

The main contribution of this paper consists of the application of the theoretical framework of ||6| to 
a simplified, but realistic, "Bluetooth-like" protocol comprising of a finite number of possible physical 
layer (PHY) coding and modulation schemes (referred to in the following as PHY modes), each of which 
is characterized by a fixed data rate and given Packet Error Rate (PER) function of the received SNR. 
We start by addressing the calculation of the minimum energy function. For this problem, we provide an 
exact solution method based on Lagrangian duality in the case where the PER functions, for each PHY 
mode, are indicator functions (PER equal to for received SNR above some mode-dependent threshold, 
and equal to 1 otherwise). In the general case of smooth PER functions, we propose an achievable upper 
bound and a lower bound on the minimum energy function. The upper bound is based on finding an 
appropriate feasible energy allocation policy, while the lower bound is obtained by finding a piecewise 
linear upper bound on the effective rate function resulting from the actual (packet error-prone) PHY 
modes. Next, we apply the general dynamic scheduling policy of ||^ to the case of a discrete set of 
non-ideal error-prone PHY modes, and we provide a near-optimal scheduling rule that operates close to 
the optimum energy-delay tradeoff. Finally, we observe that in the Bluetooth protocol the polled sensor 
needs to send NULL packets even when there is no data to transmit, in order to maintain the connection 
alive. In practice, these packets require some non-zero energy cost. Therefore, it may be convenient to 
release the connection and switch to sleeping mode in the case of a very bursty arrival process. Based on 
this observation, we develop a novel improved policy that switches to sleeping mode whenever the power 
necessary to release the connection and re-establish it at a later time is smaller than the conditionally 
expected power required to keep the connection alive, given the current system state. This new policy 
goes beyond the framework of ||6|, and provides significant power savings for practically relevant system 
parameters. 

The paper is organized as follows. Section [n] defines a protocol closely inspired by Bluetooth, with 
some necessary simplifications in order to obtain an analytically tractable, yet significant, problem. In 



Section III we consider the general case of a piconet comprising K sensors and a hub. The calculation of 
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the minimum energy function is treated in Section IV In Section |V| we apply the near-optimal dynamic 



scheduUng framework of \6j to our setting, and in Section |Vl] we discuss the behavior of the scheduling 
algorithm in the case of bursty arrivals, provide a new dynamic sleep switching policy and demonstrate 
through numerical examples its gain over the conventional policy that does not switch to sleep mode. 



Conclusions are pointed out in Section VII 



II. A Bluetooth-like protocol 

The PHY of the enhanced Bluetooth protocol fE] supports 3 data rates. The basic rate corresponds to 
a 1Mbps raw data rate using GFSK modulation ||3|. The enhanced rate modes use the 7r/4-DQPSK and 
8-DPSK with Gray bit-labeling, to achieve 2Mbps and 3Mbps of raw data rates. Since the signal 
bandwidth is approximately 1 MHz, these correspond to spectral efficiencies iii = 1 , i?2 = 2 and i?3 = 3 
bit/s/Hz, respectively. The Bit Error Rates (BERs) of each of the modulation schemes in Additive White 
Gaussian Noise (AWGN) are given by the well-known exact or tightly approximated expressions below 

(H, inj: 



1 / a2^52\ 
ei(snr) = Qi(a, 6) - - exp ( ^ — \ h{ah) 

e2(snr) ~ Q (^^snr(2 - ^/2)^ 

e3(snr) ~ (^i^^ {^/l + sin(7r/8) -yjl- sin(7r/8))) , (1) 

where ei(snr) denotes the BER for modulation scheme z as a function of the received Signal-to-Noise 
Ratio (SNR), denoted by snr, Qi{a, h) and Io{ab) denote the Marcum function and the zero-order modified 
Bessel function of the first kind respectively pT|, and a and b are given by 



a, b 



with h = 0.29. 

Data packets consist of an Access Code (AC) that identifies the piconet, a Header (H) with various 
control information, and payload Data (D). AC and H are always transmitted using the basic rate, while 
D can be transmitted using any of the above modulations. As implemented in most commercial chipsets, 
we consider hard detection. Successful reception of the payload data can only occur after AC and H have 
been decoded successfully. For a given snr, constant over the transmission of a packet, the probability of 
successful decoding of the payload data is given by PD(snr) = PA,(snr)PHs(snr)PD^(snr), i.e., by the 
product of the individual probability of success of the three detection phases. 
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The AC is composed of 72 bits, 64 of which form a synchronization word with minimum Hamming 
distance dn = 14 between ACs of different piconets. If the Hamming distance between the detected 
and the expected synchronization words is not larger than the correlator margin p, the correlator at the 
receiving node triggers the reception of the packet; otherwise the packet is discarded. Thus, 

PA.(snr) = - ei(snr))64-^ (3) 

Notice that p is not specified by the standard and can be set by the manufacturer. In our simulations, we 
assumed p = 6 p2| . 

The header is composed of 18 bits, each encoded by a (3,1) repetition code. The probability of a 
header being successfully decoded is given by 

PH.(snr) = ((l-el(snr))3 + 3el(snr)(l-el(snr))2)'^ (4) 

The header also contains a checksum for error detection, used to verify header integrity after decoding. 
The checksum is designed so that the probability of undetected error is sufficiently small, such that we 
can safely assumed that decoding errors can be revealed with probability 1. 

The payload can either be encoded using a rate 2/3 extended Hamming code or be transmitted uncoded. 
In particular, the enhanced rates are uncoded so that 

PD.(snr) = (l-ei(snr))^', (5) 

where i is the chosen rate, and Bi is the number of payload bits, as given in Table [II] The payload 
can be transmitted over 1, 3, or 5 time slots. When more than one time slot is allocated, the protocol 
overhead (AC and H) is only included in the first time slot. Therefore, a larger number of slots yields 
lower relative protocol overhead, but also a larger probability of packet error. 

When a node has nothing to send, but the connection to the piconet is to be maintained, "NULL" control 
packets are used. These have AC and H as described above, but contain no payload. In this case, the 
probability of successful NULL packet detection is simply given by -PNULL(snr) = Pa^ (snr)PH, (snr). 
The minimum received SNR required to stay connected to the piconet shall be denoted by snro- For 
example, snrp = 8 dB yields PNULL(snro) ~ 0.95. 

It is also interesting to notice that the basic rate is not competitive with respect to the two enhanced 
rates, due to the poor BER performance of non-coherent GFSK. Therefore, in our results we shall consider 
only enhanced data rates for the payload. Fig. |2] shows probability of successful packet detection vs. the 
received SNR for the enhanced rate modes for different payload lengths. 
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Bluetooth supports both Asynchronous (ACL) and Synchronous (SCO) types of data transfer. Corre- 
spondingly, different logical link control and transport layers have been defined in the system architecture 
specification. In the system considered here, the hub acts as the master of the Bluetooth piconet and 
polls each sensor according to some scheduling scheme, to be investigated later The sensors (slaves) 
respond with an information packet on the next slot(s). ACL transfer supports asymmetric transmission 
rates, flexibility of non-periodic polling, re-transmission and the ability to maintain piconets with several 
slaves. Therefore, ACL is better suited for the application in mind. When a device has an active ACL 
link, it is said to be in the connected state, and can communicate with the master whenever polled. 

In this work we assume that a connected slave device responds to polls from the master by sending 
data packets at given power and rate, according to the PHY layer options described before, or NULL 
control packets if the slave has nothing to send; we emphasize that NULL packets must be received 
correctly with sufficiently high probability; otherwise the network loses synchronism. While previous 
theoretical work Q, |[7| assumed that there is no power cost when no data are to be transmitted, the 
NULL packet transmission does incur a power cost - a fact that we shall specifically take into account 
in this paper As an alternative to NULL packet transmission, a device can be disconnected from the 
network if it has nothing to send for a long time. In this case, an (implementation-specific) power cost is 
incurred in the disconnection and later inquiry, paging and re-connection operations. In our simulations 
we have considered a reconnection cost equal to some integer multiple r > 1 of the cost of sending a 
NULL packet, assuming that the reconnection operation requires r NULL control packets to be sent by 



the sensor (see Section VI ) 



III. Problem set-up 

Consider the system shown in Fig. [3j with K transmitters (sensors) and one receiver (the local hub). 
Time is divided into slots, each of which comprises WgTg complex symbols (channel uses), where 



Ws is the slot bandwidth and is the slot duration 1 13 Ch. 8]. Rates are expressed in bit/s/Hz 



The complex discrete-time base-band equivalent channel model for sensor k transmission is given by 

K 

= Vs^)Mt) + (6) 

k=l 

where y(t), Xfc(t), z(t) € denote the received signal, the transmit codeword and the AWGN in slot 
t, and where Sk{t) denotes the channel fading state, assumed to be constant in each slot, and changing 
randomly from slot to slot according to some i.i.d. process. This block-fading channel model is motivated 
by the fact that, in typical WBANs, the coherence time and coherence bandwidth ai^e of the order of 10 
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ms and 10 MHz |[9|, |14|, |15|, and thus they are respectively larger than the packet duration and of 
the signal bandwidth. Furthermore, a Bluetooth-like protocol makes use of slow frequency hopping |[8], 
for which different packets transmitted at sufficiently far apart frequencies undergo independent channel 
states. The average transmit energy per symbol of sensor k in slot t is defined as 

Ekit) = ^E[\Mt)\\% (7) 

and the AWGN is normalized so that its components are i.i.d. ~ CA/'(0, 1) (complex circularly symmetric 
Gaussian with unit variance and zero mean). As in Bluetooth, we consider Time-Division Multiple Access 
(TDMA) where the hub schedules a single transmitter to be active over any slot t. Hence, in the channel 
model ^ the sum over k contains effectively only one term for k = k{t), where k{t) denotes the index 
of the scheduled transmitter at slot time t. Correspondingly, Ek{t) = for all k / k{t). 

For the scheduled sensor k{t), we let £{t) and Em-^{t) denote the PHY mode and the corresponding 
transmit energy chosen by the scheduUng poUcy, respectively. Consistent with the Bluetooth-like protocol 
outlined in Section [Ilj we assume that a finite number L > 1 of possible PHY modes are available, where 
each mode £ is characterized by rate Ri and a probability of successful packet detection, function of the 
received SNR, denoted by P^(snr). For example, in the case of Bluetooth, we have P^(snr) = PD(snr) 
for the corresponding enhanced rate mode and packet length. The received SNR for sensor k{t) is given 
by the product snr^j-^) = £'fc(f)(t)S'fc(j)(t). Also, we assume that the PHY has an idle mode denoted by 
1 = 0, with transmission rate Rq = and minimum received SNR equal to some snro > 0, that depends 
on the reliability with which the NULL control packets need to be detected. Without loss of generality, 
we assume i?o = < i?i < • • • < Rl- Letting snrg = 0, we can consider the ideal case where NULL 
slots do not incur any power cost, as considered in ||7|. 

We define the conditional successful decoding event A{£, e, s) for PHY mode i with transmit energy 
e and channel fading state s as: 

A{i,e,s) = {successful decoding at slot t\£{t) = £,Ei^(^f^{t) = e,5fc(t)(t) = s} . (8) 

By definition, we have Pi{es) = E[l{^(£, e, s)}]. [^The data measured by the A;-th sensor form an i.i.d. 
arrival process Ak{t), with arrival rate E[^/(.(t)] = bit/s/Hz. Arrival processes are assumed to be 
bounded with probability 1, i.e., there exists some constant ^max such that ¥{Ak{t) G [0,^max]) = 1 
for all k. Each sensor k has a transmission queue with backlog Qk{t), also expressed in bit/s/Hz after a 



^Notice that hopping is done on a per-packet basis, not a per-timeslot basis. 

^1{.4} denotes the indicator function of an event A in the underlying probability space. 
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suitable normalization. We assume that some error detection and logical link control mechanism keeps 
the information bits in the transmit queue for later transmission if a packet error occurs. Then, the 
transmission queues evolve according to the stochastic difference equations 

Qk{t + l) = [Qk{t)-Re^t) xl{A{m,Ek{t),Sk{t))} x l{k{t) = k}]^ + Ak{t), (9) 

for k = 1, . . . , K, where [x]^ = maxjx, 0}. 

By Little's theorem |16|, the average delay for the system in Fig. [3] is given by = Qi^/Xk, where 
Qfc = lim^^oo J X]t=o ^[Qfc (''")] limit of the average queue buffer size. When Qf. < 00 for all k, 

the queues are said to be strongly stable |17| . Under our system assumptions, a necessary and sufficient 
condition for strong stability is that the average service rate for each sensor k must be larger than its 
arrival rate, i.e., 
1 

\immf-^E[R,^,)Xl{A{eiT),Ek{T),Sk{T))}xl{kiT) = k}]> \k, ^ k = l,...,K. (10) 

r=0 

A scheduling policy achieving finite Q = ^ SfcLi Qk (i-^-' finite average delay) is referred to as a 
stability policy, and the closure of the convex hull of all arrival rate vectors A = (Ai, . . . , Ax) such that 
there exists a stability policy is referred to as the stability region, and it is indicated here by A, consistent 
with the notation of ||6j, |[l8|Q 

The average transmit energy per symbol for a policy 7r(t) = {k(t),£{t), Ef.(^i-j{t)) is given by 

t-i K 

E= \im - V VE[i?fe(r) x 1{A;(t) = A;}] . (11) 

t~>oo t ^ — ' ^ — ' 
r=0 k=l 

The minimum energy function, indicated by <&(A) consistent with ||6|, |18|, is defined as the minimum 
average transmit energy per symbol required for stability under the arrival rate vector A G A. Using 



1 18 Theorem 1], which can be applied in our case almost verbatim, we have that <I>(A) is achieved 
by a randomized stationary policy, i.e., by a time-invariant random mapping of the channel state vector 
S(t) = {Si{t), . . . , Sxit)) into a scheduling decision. Formally, such a policy is defined by the conditional 
probability distribution 

P!C^,c^,sMk,i,e\s) = P(/C, = k,C^=i,£^ = e\S = s), (12) 

where S denotes the channel state vector, and /C^r , C-^^ and denote random variables defined over 
{!,..., K}, {0, . . . , L} and M_|_ (the set of non-negative reals), indicating the index of the scheduled 



''This is referred to as "capacity region" in 18 , but we prefer to reserve this term to indicate the Shannon capacity region 
of a multi-terminal network, which may or may not coincide with the stability region, depending on the assumptions. 
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sensor, the index of the selected PHY mode, and the corresponding transmit energy, respectively. Such a 
policy works as follows: at given slot time t, sensor k{t), is scheduled with PHY mode £{t) and transmits 
with energy ^fc(t)(0 with probability P,c^^c^^£^isiKt)Jit),Ek(t){t)\S{t)). In Section 
calculation of 4* (A) for the system at hand. 



IV 



we discuss the 



More generally, the energy-delay tradeoff region of the system for given arrival rates A is defined 
as the set of points {E, D) in the energy-delay plane for which there exists a scheduling policy vr that 
achieves an average delay Y.k=i Dk < D with average energy per symbol equal to E. The Pareto 
boundary of this region is the optimal energy-delay tradeoff Q. In general, the optimal energy-delay 
tradeoff is a non-increasing convex curve with the horizontal asymptote E | ^*(A) as D — )• cxd. It is 
known ||6|, ||7| that scheduling policies that depend on the channel state only (i.e., which disregard the 
queue buffer states) cannot achieve optimal energy-delay tradeoff. Therefore, as in |^], we are interested 
in the class of randomized stationary policies vr, mapping the channel state vector S{t) and the buffer 
state vector Q{t) = {Qi{t), . . . ,QK{t)) into a scheduling decision. Formally, such a policy is defined 
by the conditional probability distribution 

^yc„£.,^,|s,Q(/^,^,e|s,q) = P(/C. = fc,£. = i,S^ = e|S = s,Q = q), (13) 

where all random variables are as defined above, and Q denotes the buffer state vector. Such a policy 
works as follows: at given slot time t, sensor k{t), is scheduled with PHY mode i{t) and transmits with 
energy Ek(t){t) with probability Ptc^^c^^£^\s^Q{k(t),l[t),E^t){t)\S{t),q,{t)). In Section|v|we apply the 
dynamic scheduling framework of [6] to the system at hand and obtain a family of policies that can 
operate closely to any desired point of the optimal energy-delay tradeoff curve by appropriately tuning 
a control parameter. 

IV. Minimum average energy subject to stability constraints 

Let S = . . . , Sk) denote a random vector with the same first order marginal probability cumulative 
distribution function (cdf) Fs{s) of the channel state S(t). As anticipated before, an underlying system 
assumption is that the network must be designed in order to guarantee successful reception of the NULL 
packets with sufficiently high probability. In practice, in the case of protocol errors, some paging and 
synchronization mechanism allows to restart operations. |^ However, for simplicity, protocol errors are 
not taken into account and snro is fixed such that the -PNULLlsnro) is sufficiently large. In particular, in 



^For example, anyone using a Bluetooth wireless mouse has had the experience of occasional "mouse disconnected" error 
messages appearing on the laptop screen. 
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order to guarantee snr^-^ > snro > with probability 1, we assume that Fs{-) is such that E[l/5fc] < oo 
for all k. More details on the channel state cdf used in our numerical results, relevant for the WBAN 
scenario, is given at the end of this section. For the rest, the minimum energy calculation discussed here 
is general, and holds for any continuous, discrete or mixed-type [19] fading distribution. 



Finding <I>(A) consists of solving for the conditional probability distribution (12i such that the cor- 
responding randomized stationary policy minimizes E subject to stability of all queues. It is useful to 



separate the discrete and continuous parts of the conditional probability distribution (12i as 



(14) 



The discrete conditional probability distribution Py^; £^|g(/c, £|s) is represented by a matrix-valued func- 
tion W(s) G [0, 1]^><('^+1) with {k,i) element Wk/{s), such that 



Pjc^,c^\s{k,l\s) = Wk,i{s), V s e 



(15) 



The continuous part corresponds to the energy allocation random variable ^{s), conditionally distributed 



according to P£^\/c^,c^,si^\f^j^j^)- Using the stability condition (10), <^*(A) is given by the value of the 
optimization problem 



minimize E 



wfc/(s)gfc/(s) 



k,i 



(16) 



subject to E 



> Afe, V /c = 1, 



l"^W(s)l = 1, V s e M+ 

¥{sk£kA^) > snro) = 1, V s G M^, = 1, . . . , i^, ^ = 0, . . . , L, 
Wk,i{s)>{), VsgM^, k = l,...,K, i = 0,...,L, 

where 1 denotes the all-one vector, and where the conditional successful decoding event A{£, e, s) is 
defined in ([8]). Using iterated expectation, we can write 



E 



Y,WkA^)Re X l{A{£,£kAS),Sk)} 



E 



E 



E 



E 



Y,wkA^)Ri X HA{e,£kAS),Sk)} 



S, £kj(S) 



^WkAS)Re xE\l{Ai£,£kAS),Sk)}\ S,£kAS) 



^ WkA^)ReRii^kA^)Sk 



(17) 
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Using ( 17i into the rate constraint in ( 16l, we rewrite our problem as 



minimize 



subject to 



E 



E 



kl 



(18) 



Wk,e{S)RiiPi{£k/{S)Sk 
l"^W(s)l = 1, V s G 
HskSkM > snro) = 1, V s G 



>Afc, yk = i,...,K 



1,...,K, £ = 0,.. 



Wk/is) > 0, V s G 



k = l,...,K, i = 0, 



The form of problem (18 1 is appealing since the conditional effective rate terms RiP£{£k/{S)Sk) 



appearing in ( [TT] ) coincide with the average "goodput" (product of the transmitter rate times the probability 
of decoding success) corresponding to each PHY mode i with received SNR equal to £k^£{S)Sk- For 
general smooth functions P^(snr), finding the optimal stationary policy (i.e., the matrix W(s) and the 
energy conditional probability distribution P£-^|A:,,£„,s(e|^, ^, s)) is not easy. In fact, using Caratheodory 
theorem and the approach of |[T8|, the solution can be given as a convex combination (whose coefficients 
need to be optimized) of K + 2 pairs of matrices {Wj (s), Ej(s) : j = 1, . . . , K + 2} for each channel 
state s G M.^ where Wj(s) are instances of W(s) and Ej (s) contain instances of the realization of the 



random variable £k.e{s) for all k,£,s (see |18 Appendix A] for details). This approach, however, does 



not lead to a viable computational method since it requires discretizing the channel state space into a 
sufficiently fine grid of points S C M.^, and solving the corresponding non-convex optimization problem 
in 2LK{K + 2)\S\ variables. 

In order to overcome this difficulty, we propose a method that efficiently finds an achievable sub- 
optimal solution <&(A) and, similarly, a lower bound ^(A) < '&(A). The achievable upper bound on the 
minimum energy function is constructive, and leads to a feasible scheduling policy that achieves stability 
whenever $(A) < oo. The lower bound allows us to precisely quantify the loss incurred by the simplified 
feasible policy. In order to prove upper bound, lower bound, and an efficient solution method, we need 
some auxiliary results given below and proved in Appendix [A] 

Define the effective rate vs. SNR function 



/u(snr) = ^max^{ii£P^(snr)} , 



(19) 



with domain snr > snro. An example of such function is shown in Fig. |4j where /i(snr) is plotted vs snr 
(in natural scale, not in dB) for the case of snro = 8 dB, £ = 1 and £ = 2 corresponding to the 2dh3 and 
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3dh3 enhanced data rate modes of Bluetooth with payload length equal to 3 slots, used throughout our 
numerical results (see Table. 



Let /i(snr) denote the upper concave envelope |20| of /i(snr), with the same support. By definition, 
for all £, we have 

RiPi^sm) < fi{sm) < Jl{snr), V snr > snro- 



Hence, a relaxation of problem ( 1 8 1 is obtained as 



minimize 



subject to 



E 



E 



kl 



(20) 



l"^W(s)l = 1, V s E 

P(sfcffc/(s) > snro) = 1, V s G 



> Ai,, V /c = 1, 



1,...,K, £ = 0,.. 



Wk/is) > 0, V s G 



k = i,...,K, e = o, 



We have: 



Lemma 1: The relaxed problem (20 1 admits a solution where £k/is) is a deterministic function ek/{s) 
of k, i and s. ■ 

The following result identifies a case for which the relaxation is tight. 

Lemma 2: Consider the case P^(snr) = l{snr > ag], for some SNR thresholds oq = snrg < ai < 
• • • < CLL, and assume that the non-decreasing piecewise linear function joining the points {ap^Rp) for 
£ = 0, . . . , L + 1 is concave (note: for convenience we define aL+i = +oo and Rl+i = Rl)- Then, 



the relaxed problem (20) yields the same value as the original problem (18 1, and this is obtained by the 
deterministic energy allocation function ek,i{s) = ap/sk- ■ 
It is also immediate to observe that when the PHY mode success probabilities are given by indicator 
functions (as in the assumption of Lemma [2]) but the piecewise linear function joining the points (a^, Rp) 
for ^ = 0, . . . , L + 1 is not concave, then we can obtain an equivalent problem with a reduced number 
V < L of PHY modes, by retaining only the modes for which the corresponding point (a^ , Rp) is on the 
boundary of the convex hull. In other words, PHY modes whose SNR threshold - rate point (a^, Rp) is 
inside the convex hull of other modes are irrelevant as far as the minimum energy problem is concerned, 
and can be dropped without changing the system performance. Therefore, there is no loss of generaUty 
in the concavity assumption of Lemma [2] 
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Summarizing: we have identified one case, namely, the case where the PHY mode success probabilities 
are given by indicator functions l{snr > a^} for some mode-dependent SNR thresholds a£, for which 
the relaxation obtained by replacing /i(snr) with its upper concave envelope 7Z(snr), does not increase 
the value of the problem. Moreover, in this case the optimal energy allocation is deterministic, given 
explicitly by ek/{s) = a^/sk- As we will see next, for this case we can find efficiently an exact solution. 
Since the case of concave increasing piecewise linear rate functions is easily handled, it is natural to 
seek achievable upper bounds and lower bounds for the case of general ^^(snr) by defining appropriate 
concave piecewise linear rate functions. 



A. Exact solution for the case Pf(snr) = l{snr > a^} 

In passing, we notice that this case is relevant for long packets and strong channel coding schemes. 
For example, assuming a family of capacity-achieving codes for the circularly symmetric AWGN channel 
1 21 1, and using the strong converse to the channel coding theorem]^ we have that the successful decoding 
probability for rate behaves as an indicator function with SNR threshold = 2^* — 1. In practice, 
heavily coded systems (e.g., systems using powerful turbo or LDPC codes p3| , or concatenated convo- 
lutional and Reed-Solomon codes fTTl) are characterized by very sharp error probability waterfalls: as 
soon as the received SNR falls below a certain code-dependent threshold, the post-decoding block error 
probability increases very rapidly. In this case, approximating P£(snr) with an indicator function for an 
appropriately chosen SNR threshold may be meaningful. 

By Lemmas [T] and |2] and their consequences summarized before, we have that in the case ^^(snr) = 



l{snr > a^} the minimum energy function problem ( 18 1 is equivalent to: 



minimize 



subject to 



E b'^(S)W(S)a 
E [W(S)r] > A, 
l"^W(s)l = 1, V s G 



(21) 



Wk/{s) > 0, V s G 



k = l,...,K, 



where we define b(s) = . . . , 1/sk)'^, a = (oq, . . . , aL)"*" and r = (0, 

Notice that ( pTj ) is an infinite-dimensional linear program, since both the objective function and the 
constraints are linear in the weighting function W(s). For notation convenience and later use, we let r£ 



*The strong converse result states that if an ensemble of capacity achieving codes is used at rates above the capacity, its block 
error probability converges to 1 as the block length increases. This result is proved in great generality in (22). 
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denote the £-th components of the rate vector r. We shall discuss the solution (21) allowing for some 
lack of rigor. We can think of W(s) as an array of variables Wk/{s) for each k,i and s, and replace 
expectations with the corresponding Stieltjes integrals | [l9| . |^Then, the Lagrangian function for (21 1 is 
given by 

b"^(s)W(s)a-cu"^(W(s)r-A) + zy(s) fl"^W(s)l-l)l dFs{s), (22) 



where u (non-negative vector) and z^(s) (non-negative scalar function) are dual variables. By taking the 
partial derivative with respect to Wk,e{s), for given k,£ and s, we find 



dC 



dFsis) 



04 
Sk 



(23) 



Then, since (21 1 is a linear program in W(s), the solution must be found at the vertex of the domain of 



W(s) for which the inner product between W(s) and the vector of partial derivatives is minimum. This 
corresponds to choosing with probability 1 the sensor k with PHY mode £ such that the corresponding 



term 



dC 

dwk,e{s) 



in (23 1 is minimum. Hence, we have proved the following result: 



Theorem 1: The minimum of (22i over W(s) for fixed cj > and given vectors a and r is given by 

1 ifwfcr^-f^ >t^irj-^V(f,i) 



Wk,i{s) 



otherwise 



(24) 



The solution ( |24| corresponds to partitioning the channel state space into decision regions TZk,i = 
{s € : Wk/{s) = 1}. These regions fov K > \ sensors are not just simple hyper-rectangles, and 



therefore it is difficult to obtain a more explicit characterization. We will see in Section IV-E that for the 
single-sensor case the regions are intervals that can be characterized more explicitly. In general, letting 



Wuj(s) denote the solution (24i, we can define the corresponding average sum energy: 



E 



b"^(S)Wcj(S)a 



(25) 



and average rate vector 



C(c^) =E[W,^(S)r]. (26) 
Although the decision regions defined by Theorem [T] do not lead, in general, to a closed-form for the 



expectations in ( [25] ) and in ([26]), these can be easily computed by Monte Carlo averaging over the channel 
fading state S ~ Fs{s). Eventually, the minimum energy function for given threshold SNRs vector a 



more rigorous approach consists of using variational calculus, but here we chose this more intuitive argument. 
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and rate vector r, can be obtained by solving the Lagrangian dual problem with respect to u, i.e., by 
maximizing £(Wcj,a;) over u G M.^^ This can be obtained by a subgradient method, starting from 
some initial value a;(0) G M+, and successively updating the dual variables according to 

1) = cj(n) +e„v(n), (27) 

where v(n) is a subgradient for the problem. A subgradient can be found by noticing that, for any 
u' ,u G M^, since W^' is a minimizer of £(W,a^'), we have 

< r{u)-{uj'f{c{u)- X) 

< £(Wc^,cj) + -u;)"^(A- C(cj)). (28) 
It follows that a subgradient at u{n) is given by the vector v(n) = A — C(a^). The sub-gradient iteration 



(27 1 with this choice of the subgradient has an intuitive meaning: if for some k, the k-th component 
of the vector A — C{u) is positive (i.e., the average service rate of sensor k is below its arrival rate 
Ajfc), then the corresponding weight ijJk{n) is increased. Otherwise, it is decreased. The iteration step can 
be chosen as e„ = eo^^f. for suitable parameters eg, 6 > 0. The resulting sequence of values T{u{n)) 
obtained by the above iteration converges to <I>(A) as n — oo (in practice, we checked that convergence 
is very fast). 

B. Achievable upper bound on the minimum energy function 

Driven by the intuition developed for the case where the PHY mode successful decoding probabilities 
are indicator functions, we fix the receiver SNR threshold values a = (ao, • • • , a^)^, with = snro, and 



define the deterministic energy allocation function ek,i{s) = ^. Replacing this into problem (18 1, we 



obtain that the optimization with respect to W(s) is again given in the form (21 1, where now a is fixed 
a priori, and r = (0, i?ii-*i(ai), . . . , RLPL{aL)Y ■ In the example of Fig. |4| /i(snr) is shown together 
with the piecewise constant curve defined by the points {(a^, RePe{ae) : £ = 0, . . . , L}, corresponding 
to a specific choice of the target received SNRs a^. Eventually, we arrive at a linear program formally 
identical to what we have already solved, for a given set of receiver SNR values and for the corresponding 
set of effective rates = RiPi{af). Therefore, Theorem [T] and the subgradient iteration can be applied 
verbatim, yielding the solution W(s;a) and an achievable upper bound $(A;a) > <1>(A). 



Since the constraint corresponding to the dual variable v{s) must be satisfied with equality for the solution Woj in l |24| 
then i'(s) becomes irrelevant and it is dropped for notational simplicity. 
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The achievable upper bound can be tightened by optimizing over a, through an educated exhaustive 
search over an appropriate domain. In order to determine a suitable search domain, consider the typical 
behavior of ^(snr) as shown in the example of Fig. |4] We notice that for each ^-th PHY mode there 
exists a narrow interval where the effective rate presents a sharp transition between very small to almost 
Ri effective rate. This corresponds to the "waterfall" of the successful decoding probability P^(snr) (see 
Fig. 2 1. The optimal values of ai is found in this transition interval, indicated by [snr^'^\ snr^^^]. As a rule 
of thumb, we choose snr^^^ such that Pi{snTf^) = 0.99, and snr^^^ such that P£{s<nr^p) = 0.1. We argue 
that searching outside this interval is useless. In fact, for ai < sm^p the contribution of PHY mode t to the 
overall average rate is too small, and therefore this mode is never selected by the scheduling policy (i.e., 
the corresponding probability Wk/{s:) solution of (21 1 is zero for all k and s). In contrast, for > snrl^^ 



the contribution of PHY mode £ to the average rate does not increase, since it is essentially already 
almost equal to its upper bound R^, while the contribution to the average energy increases linearly with 
a£. Therefore, the proposed achievable upper bound <I>(A) to the minimum energy function is obtained by 



(0) (1) 



, for such appropriately 



minimizing <I>(A;a) over a in the Cartesian product region Y\^=i 
defined intervals. For small L, as the Bluetooth-like system at hand, this can be done by discretizing 
this L-dimensional hyper-rectangular search region and exhaustively calculating $(A;a) for each a in 
the discretized grid. Notice that this complexity depends on the number of transmission modes L and 
on the shape of the mode effective rate function (e.g., see Fig. |4]), and not on the number of sensors 
K. We wish to remark that this search is needed only for the purpose of performance evaluation, and 
it is performed off-line. This has no impact on the complexity of the dynamic scheduling algorithms of 
Sections fvl and fVll as we shall discuss later. 



C. Lower bound on the minimum energy function 

As mentioned before, we construct a lower bound for <&(A) by finding a piecewise linear concave 



function pt(snr) > Jl{sm) and use this in the relaxed problem (20i. The rate function upper bound is 
obtained as follows. Let So = snro and JIq = 0. Then, for £ = 0, 1, . . . , L — 1, find the straight line 
passing through the point {a^,Jle), strictly upperbounding /i(snr) for all snr > with the exception of 
at most one tangent point. Let the straight line be given by 

y = mi{x-ai) +pt£, 

for some rui > 0, and find the intercept of this line with the horizontal line y = Re+i- Denote the 
abscissa of this intercept by a^+i, let Jie+i = Re+i, let + 1 and repeat the procedure. In this way. 
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by linearly interpolating the obtained points, we have constructed a piecewise linear function /I(snr) with 
L + 1 segments joining the points {(a^,/!^) : £ = 0, . . . ,L}, completed with a last horizontal segment 
snr = Rl for snr > ai. The example of Fig. |4j shows /i(snr) obtained as said above, together with the 
actual non-concave rate function /u(snr). 

From the proof of Lemma |2] it is apparent that the relaxed problem (20 1 obtained by replacing 7l(snr) 



with the concave piecewise linear upper bound pt(snr) is equivalent to the original problem (18 1, with 
indicator function probabilities (snr) = l{snr > ag}. Hence, Theorem [T] and the subgradient search 
illustrated before can be used to efficiently obtain the sought lower bound ^(A). 

D. A numerical example 

As a concluding example, we show in Fig. [5] the upper and lower bounds to ^(A) for the case of a 
single sensor K = \, and the rate functions of Fig. |4| obtained with the fading cdf Fs{-) used throughout 
all numerical results in this paper, described below. Three curves are shown. The solid line corresponds 
to <^*(A) obtained as explained before, including the optimization over the receiver SNR vector a. The 
dotted line shows a non-optimized upper bound, obtained by choosing the threshold SNRs such that the 
corresponding Pe{a£) = 0.99. These are the same values corresponding to the piecewise constant rate 
function of Fig. |4j and are included here to show the effect of searching over a. Finally, the dashed line 
corresponds to ^(A) calculated as explained above, using the function pt(snr) shown in Fig. |4j 

a) Remark on the channel state statistics: The problems leading to <1>(A), ^(A) and ^{\) are 
generally feasible if the products a^E[l/S'fc|S G Tik/] are finite for all k,l. This may not hold for some 
fading distributions. For example, in the case of Rayleigh (resp., Ricean) fading, Sk is central (resp., 
non-central) chi-squared with two degrees of freedom. For K = \ (single sensor) and TZi^i containing 
the origin, then the expectation of the inverse channel fading is unbounded. In particular, for the case 



= 1 we have the policy decision region (see Section IV-Ei TZifl = [0, si) for some fading threshold 
si > 0, so that snroE[l/S'|5 G [0,si)] is unbounded, unless snrp = 0. It should be noticed here that for 
any K > 1 the multiuser diversity inherent in the system is sufficient to achieve finite average energy 
even for snro > 0. Nevertheless, in order to avoid analytical problems with the case K = 1, snro > 0, 



in all numerical results presented in this paper we used a truncated Ricean fading distribution 1 1 1 1 with 
probability density function (pdf) fs{s) with support s £ [smin,oo), with Rice factor /C = 6.95 dB, unit 
second moment and where Smin = 0.01 corresponding to a deep fade of —20 dB. These fading statistics 
are relevant for typical WBAN. 
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b) Remark on the Bluetooth packet length: In the Bluetooth- like system model, each transmission 
can span 1, 3 or 5 time slots with different rate/successful detection probability tradeoffs. We assume that 
the span of each packet is not adapted on a per-slot basis, but it is optimized offline, based on the fading 
statistics. Therefore, the number of time slots per payload is fixed for all transmissions. We evaluated the 
<I>(A) for each of the packet lengths using the method given in this section, and we found that for a wide 
range of arrival rates the minimum energy is achieved for payload length of 3 time slots. Hence, in all 
numerical results presented in this work we set the number of slots per payload to 3, i.e., we used PHY 
modes 2dh3 and 3dh3 of Table [11] and Fig. [2] The corresponding effective rates, including the protocol 
overhead, are given by i?i = 2 x 367/371 and i?2 = 3 x 552/556. 

E. A closer look at the single-sensor case 

In this section, we take a closer look at the single-sensor case and provide more insight on the structure 
of the policy achieving ^{X) (in the case Pii{sm) = l{snr > a^}) or ^{X) (in the general smooth ^^(snr) 
case). In both this section and Section |Vlj considering a single sensor, we drop the sensor index for the 
sake of notation simplicity. 

The decision regions of Theorem [TJ in this case, are given by: 



{cll,tl) define a concave non-decreasing piecewise linear function for snr > oq. This corresponds to the 
general principle of diminishing return that typically occurs in communications channels, such that any 
additional increment of received SNR provides proportionally less and less rate as SNR increases. For 
example, the SNR thresholds = snr^ = 2^'* — 1 corresponding to a family of capacity-achieving codes 
for the circularly symmetric AWGN channel satisfies this property. 

Under this concavity condition, it is immediate to see that the regions TZ^ are in fact intervals that 
partition the channel state space for any value of the Lagrange multiplier w > 0. Defining the 
breakpoints sq = 0, sl+i = +oo and 

S£ = —f V, (30) 

for ^ = 1, 2, . . . , L. The concavity condition implies the ordering sq < si < S2 < ■ ■ ■ < sl < and, 
consequently, IZi = [s£,S£^i). 

It follows that the optimization solution in the single sensor case takes on the intuitive form of a mode 
selection strategy that depends on the strength of the channel state: if G [s£,S£+i), then mode £ is 




(29) 



In order to proceed further, we assume that (as in Lemma |2]) the points (ao,0), (ai,ri), (a2,r2), . . ., 
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chosen with transmit energy per symbol ^. As already observed for Lemma |2j if the concavity condition 
is not satisfied, some PHY modes are irrelevant for the minimum energy solution. We can re-define the 
problem for L' < L modes, satisfying the concavity condition. Notice the upper concave envelope /i(snr) 
of the SNR/rate points {{ae, ri)} yields the achievable long-term average rate versus received SNR curve 
obtained by time-sharing between the different PHY modes. If a point lies below this curve, it means 
that a better SNR/rate point can be achieved by time-sharing between two other such points. Intuitively, 
this explains why these points can be discarded from the optimization. 

By using the explicit expression of the decision regions into the expression of the average energy and 
rate p5] ) and p6l ), we obtain 

rM = E r"-dFs{s)^ (31) 

« n J St ^ 



and 



L 



C{u) = Y,re dFs{s), (32) 



where the dependence on w is contained in the thresholds {si} through (30 1. Finally, the Lagrange 
multiplier is obtained by solving (numerically) the equation C{uj) = A. 

When we evaluate the achievable upper bound ^{X), searching for the optimal target receiver SNR 



vector a is easily done by using the almost closed-form expressions pT\ - ( [32] ). Then, the same values 
(which depend only on the protocol modes and not on the number of sensors), can be reused for the 
multisensor case (recall that any choice of a yields a valid upper bound). Fig. |6] shows <^*(A) for P£(snr) 
given by Fig. |2]for the two enhanced data rates 2dh3 and 3dh3, a single sensor {K = 1), and different 
choices of the NULL packet target SNR. For comparison, we also show ^{X) for a system with the same 
PHY mode rates of 2 and 3 bit/s/Hz, but exploiting ideal capacity achieving codes and snro = 0. The very 
large gap between the minimum energy function of Bluetooth-like systems and the ideal system stresses 
the fact that the PHY layer of Bluetooth is very suboptimal, in exchange for very low complexity. 

V. Minimum average energy subject to (hnite) average delay constraints 

In this section we consider the more general problem of minimizing the transmit energy subject to an 
average (finite) delay constraint, particularize the scheduling policy developed in |[6| to our setting, in order 
to operate closely to any desired point of the optimal energy-delay tradeoff curve. This policy depends on 
the control parameter V G IR+, and provably achieves near-optimal energy-delay tradeoff in the following 
sense: for V > Rl, the policy achieves delay D = 0{VV logV) with average transmitted sum-energy 
per symbol E — <^*(A) = 0{1/V). For twice-differentiable ^{X), it is known that any policy must satisfy 
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the Berry-Gallager bound: HE — ^(A) = 0{1/V) then D = r2(v^) |6|. In our case, since the channel 
fading has a continuous distribution, <&(A) is a strictly convex continuous and increasing function of A 



and therefore it is twice differentiable almost everywhere p4| with strictly positive Hessian. 

The maximum absolute variation of Qk{t) for any k from one slot to the next is bounded by Jmax = 
maxj^max, ^l}> where A^ax is the bound on the arrival process. We assume a strict peak power 
constraint Vma.x, such that 'PmaxSmin > snro, therefore, the minimum required received SNR while 
transmitting rate Rq = (NULL control packets) can always be achieved. Defining the constants 
QthX,^ > such that, for y > 0, C = S^^e"'^/''— , i/ = ^ and Qth = f log i (see [^1) the 
dynamic scheduling policy proceeds as follows. 

The scheduling policy is given in Algorithm [T] At each slot-time t, the scheduler chooses a sensor 
k{t), a transmit energy per symbol £^-^{1) and a mode l{t). This selection is given as the result of the 
optimization step ( [34] ), performed at each slot time t. The weights in this optimization are computed by 
updating auxiliary queues X(t) = . . . ,XK{t)) according to 

Xk{t + l) = [Xk{t) - ii{Ek{t)Sk{t)) - vl{Qk{t) < Qth}]+ 

+Ak{t) + vl{Qk{t)>Qth} (33) 



where ^(snr) is defined in (19 1, extended such that //(snr) = for snr < snro. Also, it is understood that 
if k{t) / k then Ek{t) = 0. 



The dynamic policy of Algorithm 1 requires the on-line computation of the minimum in (34i for all 



A; = 1, . . . , if. For Wk{t) < 0, (34i yields Eu = snro/5'fc(t). For Wk{t) > 0, using ( 19l, the minimization 



in ( p4| ) is equivalent to calculating 

min {Ve-[Wk{t)]^ RePe{eSk{t))} (36) 

ee[snro/Sfc(t),7',„ax] 

for £ = 0, . . . , L, and choosing the energy value that achieves the overall minimum. This can be 
obtained by performing L one-dimensional line searches |^ over the interval [snro/5fc(t), "Pmaxl^ with 
linear complexity in L. Also, we noticed that by computing ( [36| ) at the energy values = ae/Sk{t), 
where {a^} are the SNR thresholds resulting from the calculation of '&(A), and selecting the PHY mode 
accordingly, the performance of Algorithm 1 is practically indistinguishable from the case where the full 
line search is performed. In fact, if the probabilities P£(snr) are indicator functions, then the the minimum 



of (36l must be one of the break-points {snr^/5fc(t)}. Hence, given the shape of the probabilities ^^(snr) 



'For £ — the minimum is achieved at e — snro/Sfc(t) therefore no line search is needed. 
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Algorithm 1 Multi-sensor Opportunistic Scheduler. 
. Initialize X(0) = 0. 

• for i = 1, 2, ... repeat : 

for k = l,...,Klet: 

Ek = arg min {Ve - [Wu{t)]+ tx{eSk{t))} (34) 

where 

Wk{t) = i{gfc(t) > Qt4 X Ce^('3'' 

-l{Qk{t) < Qth} X Ce-^^'-W-Q-) + 2Xfc(t) (35) 

and let 

^ [ if EkSkit) = snro 

y argm.a^e=i^,„^L{RePe{EkSk{t))} if EkSk{t) > snro 

end for 

. Let k{t) = argmmk=i,...,K {vEk - [Wfc(t)]+ let £{t) = £^{1), Ek(t){t) = E^^t) and 

Ek{t) = for all k / k{t). 

• Let sensor A;(t) transmit with energy Ek(^t){'t) ^^d PHY mode i{t) on slot t. 

• For the current arrival vector A(t) update the queue buffers and scheduler weights according to (j9]l 
and ( [33] ), respectively. 

end for 



(see Fig.[4]), it is not surprising that the actual minimum of (36l is very close to the value at = ai/ Sk{t). 
We conclude that the complexity of the on-line optimization performed in Algorithm 1 is 0{L) with 
respect to the number of PHY modes, and 0{K log K) with respect to the number of sensors, due to the 
presence of the maximization over k. In practical WBANs, both L and K are small integers, therefore 
these complexity orders are quite irrelevant. As a matter of fact. Algorithm 1 can be easily implemented 
in the piconet hub (typically a powerful smartphone, equipped with a modern multi-core processor). 

In order to gain insight on the gain achievable by the multi-sensor dynamic scheduling policy given 
in this section, we compare its energy-delay performance with that of a suboptimal system that runs a 
single-user energy-delay algorithm independently for each sensor (see Section IV-E[ ), and uses round-robin 
channel allocation to given to all sensors the same fraction of system bandwidth. We considered a piconet 
with two sensors with same channel state statistics and two setups: 1) symmetric arrival rates Ai = A2, 
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and deterministic packet arrivals (one packet per slot per sensor); 2) symmetric arrival rates with different 
probabilities of packet arrival qi = 1.0 and q2 = 0.2. In setup 2, the arrival process of sensor 2 is i.i.d. 
with geometrically distributed inter-arrival time with F{A2{t) = 0) = 1 — 92 and F{A2{t) = \2/<l2) = '?2- 
The corresponding energy-delay tradeoff curves are shown in Fig. |7] The achievable sum average energy 



1) yields the horizontal line, and is computed using method described in Section IV for the packet 
success probabilities i-'^(snr) of Bluetooth 2dh3 and 3dh3 PHY modes, with snro = 8 dB. We notice 
that the multisensor scheduling policy, which selects opportunistically the sensor to serve on each slot, 
based on the channel state and on the queue state, achieves a significant gain in average transmit energy 
with respect to a conventional round-robin piconet scheduling. By increasing the control parameter V the 
average energy tends to its minimum, while the delay increases. We also considered an asymmetric setup 
with deterministic arrivals (one packet per slot) but the two arrival rates are different, namely Ai = 0.04 
bit/s/Hz and A2 = 1.0 bit/s/Hz. The corresponding energy-delay tradeoff curves are shown in Fig. [8] 
These examples indicate that the energy savings of the multi-sensor dynamic scheduling policy increase 
when the sensors are asymmetric, either because of the different inter-arrival statistics, and because of 
the different arrival average rate. 

VI. Improved policy with adaptive sleep mode optimization 

The scheduling policy of Section |V] is near-optimal under the assumption that there is no power 
expenditure when no pay load data is transmitted ||6|, |[7|. However, as already discussed a few times 
in this paper, in Bluetooth or similar systems a transmitter must spend power for transmitting NULL 
control packets even when it has no data to transmit. In this section we investigate an adaptive policy 
that switches between sleep and connected modes. We focus first on the single-sensor case, and then 
discuss the extension to the case oi K > 1. 

By introducing a sleep mode, the transmitter has two distinct states and the scheduling problem becomes 
significantly more complicated. A rather general formulation of the problem was addressed in terms of 



dynamic programming over "renewal intervals" in |25|, where the event of disconnecting the sensor and 



moving to sleep mode is a recurrent event that somehow "resets" the system. For the sake of a simple on- 
line implementation, here we seek a heuristic approach that yields significant improvements with respect 
to the dynamic policy of Algorithm [T] 

In order to motivate our approach, we observe the qualitative behavior of the policy of Algorithm [T] for 
fixed arrival rate A with different levels of "burstiness" of the arrival process. Consider Fig. [9} obtained 
by Algorithm [T] in the case of a bursty arrival process A{t) with i.i.d. arrivals, arrival rate A = 0.04 
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bit/s/Hz and F{A{t) = X/q) = q and F{A{t) = 0) = 1 - We notice that the scheduler tends to allocate 
high power and high rate immediately after a non-zero data arrival, when the queue buffer is large. 
Then, as Q{t) becomes smaller and eventually drops slightly the threshold Qth (see Algorithm [T]l, the 
scheduler tends to allocate smaller rates and smaller transmit powers. Eventually, it uses the minimum 
power necessary for NULL packets with zero payload data rate, until the next arrival. 

From (j9|l, ( [33] ) and (35 1 we have that if Q{t) < Qth and no arrivals occur at slot t, then necessarily 
X{t + 1) < X{t) (i.e., the auxiliary queue has a locally decreasing trajectory). Furthermore, when X{t) 
is sufficiently small such that W{t) < 0, the coefficient W{t) is certainly non-positive until the next 
arrival. It follows that when the algorithm enters the condition W{t) = 0, it keeps scheduling NULL 
slots until the next arrival time. Let Iq and ti denote two consecutive arrival times, and assume that the 
condition W{t) = occurs at t^, i.e., we define the conditional stopping time 

= min < : arrival at time to}. 

t>to 

Assuming that at time ti the buffer queue jumps above the threshold Qth and the algorithm schedules 
non-NULL slots, the average energy per symbol spent in the "idle" phase is given by 



E 



tl 

snrp 



tl > tw,to 



rsnrnl „ r 



= ^^NULL X A(t^,to), (37) 

where we define -Enull = IE [^^] as the average energy necessary to transmit a NULL packet, and 
the term A{t^,to) = K[ti — tu, + 1| ti > t«,,to] is the conditional average idle time for given t^ and 
to- For example, in the case of deterministic arrivals, which are representative of sensors that collect one 
measurement of Amax bit/s/Hz each interval of (say) N slots, we have 

A(t^,to) = E[ti-t^ + l\ti>t^,to]= N - {t^-to) + l. (38) 
In the case of geometrically distributed inter-arrival times with F{A{t) = j4max) = Q, we have 

A(t^,to) = E[ti-tu, + l\ti>tu„to] 

= E[ti\ti>t^]-t^ + 1 = ^ + 1. (39) 

Assuming that A{t^,tQ) is known a priori from the system statistics, we propose the following switching 
strategy in order to take advantage of the sleeping mode: at each new arrival to, the policy resets. Focusing 
on a given inter-arrival period and letting to be the starting time (i.e., the time of the most recent arrival). 
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if to < ty^ < ti occurs, i.e., the scheduler enters the idle interval before a new arrival occurs, then the 
policy switches to sleep mode if £'idie(*«n *o) > ^siccp> where the latter is the average energy cost of 
disconnecting and setting up a new connection as soon as a new arrival occurs. In general, ^'sieep depends 
on the paging and hand-shaking procedures, which involve the transmission of some control packets. In 
our results, we let -Egiccp = tE'null for some value r > 1, since we assume that the energy cost of 
disconnecting and reconnecting at a later time is some multiple of the NULL control packet average 



energy. Then, the improved policy switches to sleeping mode if A(t^,to) > Fig- 10 compares the 
energy-delay tradeoff obtained by the proposed switching policy for different values of r, for the same 
arrival statistics of the snapshots of Fig. |9] The case r = 10 corresponds to no switching because the 
cost of disconnecting and reconnecting is equal to the expected cost of NULL packets in idle times. In 
this case, the curve coincides with what obtained by Algorithm [1] 

In order to extend this idea to the case of A' > 1 sensors, we observe that when there exists at least 
one sensor with data to transmit in its queue buffer, it is very likely that the hub will poll this sensor. 
In this case, even though some sensors are idle, they are unlikely to be polled and therefore they need 



not send NULL packets. Instead, if all sensors have below-threshold buffers, the minimization in (34i 
yields Ef^ = snro/5fe(t) for all k. Hence, the sensor with the largest value of channel state Sk{t) will 
be polled and has to respond with a NULL packet. For independent identically distributed stationary 
and ergodic fading processes across the sensors, each sensor is equally likely to have the largest fading 
state, therefore, all sensors have the same probability l/K of sending a NULL packet. An example of 
this situation is evidenced by the snapshot of Fig. [TT] obtained by applying Algorithm [T] in the case of 
K = 2 sensors, with i.i.d. channel state and arrival processes, each of which has the same statistics as in 
Fig. |9] Based on these observations, for A > 1 we define to to be the time of the last data arrival over 
all sensors, and the stopping time tw as 

tyj = mill {Wk{t) < \/ k : last arrival at time to}. 

t>to 

In words, t^ is the first time where all sensors become idle since the last packet arrival in the whole 
piconet. Then, each sensor k calculates an estimate of the expected energy spent to send NULL packets 



as Eid\e,k{tw,to) = '^'^^^ X Ak{tw,to), where Ak{tw,to) is defined as in (39 1 for the arrival process of 
sensor k, and where the factor l/K is due to the fact that, when all sensors are idle, they transmit NULL 
packets for l/K of the slots, on average. Each sensor k switches to sleep mode if -Eidie.fcliu)) ^o) > -f'sieep- 
Suppose that at time tw some sensor switches to sleep mode. Then, at time t^ + 1, if the condition 
Wk{tw + 1) < still holds, then the same decision is repeated for the surviving network of K' < K still 
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connected sensors, by decrementing Ak{tw,to) by one slot unit. The switching decision process repeats 
for tw + 2,tu, + . . ., until some new packet arrives into the network. Sleeping sensors turn "on" again 
when they receive a new non-zero data packet and their weights become positive again. 

We expect that for > 1 the proposed switching policy can achieve significant gains over the standard 
dynamic scheduling policy of Algorithm [1] when all arrival processes are bursty. In contrast, if one or 
more sensors have full queue buffers most of the time, then the switching condition does not occur. In 
this case, sensors are rarely requested to send NULL packets, since there exists some sensor with data 
to send with high probability, and therefore the hub will likely poll these sensors. 



This intuition is confirmed by numerical simulations. Fig. 12 shows the energy-delay tradeoff of the 
proposed switching policy for = 2 symmetric sensors with arrival statistics as in Fig. 11 Fig. 13 
shows analogous curves for an asymmetric case where Ai = 0.04 bit/s/Hz, qi = 0.1, and A2 = 1-0 
bit/s/Hz and q2 = 1.0 (deterministic arrivals). The switching policy achieves significant gains over the 



non-switching policy in the case of Fig. 12 where both sensors have bursty arrival processes. Instead, in 
the case of Fig. [13} sensor 2 has always data to transmit, and the switching conditions never occurs. On 
the other hand, sensor 1 does not waste energy to send NULL packets during its own idle times, since 
sensor 2 is polled with high probability instead. 

VII. Conclusions 

We studied the minimum energy function and the energy-delay tradeoff in a wireless network inspired 
by a Bluetooth piconet with K sensors and a data-collection hub. This problem is motivated by body-area 
wireless sensor networks, where power efficiency plays a key role, but critical data must be delivered 
with low delay. This paper explicitly considers system features such as a finite (and typically small) 
number of possible data rates, simple block codes (or even uncoded modulation) with non-negligible 
packet error probabilities, and the cost of protocol overhead packets (NULL packets) in order to maintain 
a connection in the absence of payload data. In this context, we applied a known general theory of near- 
optimal scheduling for energy-delay tradeoff and have obtained an easily computable solution for the 
minimum energy function in the case where the codes packet error probabilities are if the receiver SNR 
is above some code-dependent threshold, and 1 elsewhere. This sharp transition behavior is relevant for 
very powerful codes and large block length. In the case of moderate block length and/or of weak codes 
(such as in the Bluetooth-like system considered here), the packet error probabilities are smooth functions 
of the received SNR. In this case, we developed an easily computable achievable upper bound and a 
lower bound to the minimum energy function. Furthermore, we provided an explicit scheduling algorithm 
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that provably operates along the optimal power-delay tradeoff, and at each slot performs sensor selection, 
power allocation and transmission mode (and rate) selection. Finally, we proposed a novel improved 
strategy for the case where the transmission of NULL control packets has a non-zero power cost (this 
is in fact the most relevant and practical case). Our improved strategy adaptively switches the sensor to 
sleep mode, by comparing the conditional expected cost of maintaining the connection, given the present 
state, with the average cost of disconnecting and re-connecting later on. 

The proposed algorithms are amenable for an on-line implementation at the hub node, since in 
a Bluetooth-like piconet the hub node polls the sensors, and our strategy only requires a different 
"opportunistic" polling order, that depends on the sensors queue state and on the channel state. The 
problem of learning the channel fading gains at the transmitter to a sufficient level of accuracy goes beyond 
the scope of this work, and should be addressed by some suitable two-way training scheme, exploiting 
time-division duplex operations, reciprocity and the rather large channel time-frequency correlation. 



Appendix 



A. Proof of Lemma [7] 



Using iterated expectation, we write the objective function in (20 1 as 



E 



kl 



Using the concavity of /i(snr), iterated expectation and Jensen's inequality in the terms appearing in the 
stability constraints we obtain 



E 



E 



< E 



J]«;fc,,(S)K[7l(ffc,,(S)5fc)|S] 



(40) 



Hence, for any probability assignment P£-„|A:,,£„,s(e|^, ^, s) for £k/{^) we can find the feasible deter- 
ministic energy function ek,e.{s) = E[ffe^£(S)|S = s] that yields a smaller or equal value of the problem. 



B. Proof of Lemma |2] 

First, notice that under the assumption of Lemma [2] the upper concave envelope /x(snr) coincides with 
the piecewise linear function joining the points {a£,Ri) for £ = 0, . . . , L + 1. For any feasible W(s) 
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and randomized energy allocation £k/{^) with conditional distribution P£^\jc„,c,r,si^\k, define the 
quantized energy allocation 

for SkAs) > ^ 
'-, for <5fc/(s) < 

Notice that the equality l{£k.e{s)sk > a^} = l{'Sk/{s)sk > ae} holds with probability 1 for all k,i and 



Sk 



Sk ' 



(41) 



s. Then, the terms in the stability constraints of (18 1 are preserved by replacing £k/{s) with ^^ ^(s). 
Furthermore, since F{Ek/{s) < £k/{s)) = 1 for all k,i and s, we have that the objective function in 



(18 1 cannot increase by replacing £k,e{s) with Ek.e{s). Hence, the optimal energy allocation must be in 



the quantized form (41 1 with at most two mass points, one at ^ and the other at ^, with probabilities 
indicated by ^k,i{^) and 1 — ik/{^), respectively. 



When restricting the energy allocation to the two-mass point random variable (41 1, the objective 



function in (|T8]l takes on the form 

E 



E 



E 



i=0 



Wk[p) \t>k Ok 



k 

_^y^ Wk,e{S) 



WkfijS) 
Wk{S) 



i=i 



Wk/{S) 
Wk(S) 



(i-MS)) 



Sk 



^ Wk{S) Sk 



E 



Sk 



(42) 



^Wk{S)^we\k{S) 

k e=o 

where Wk{s) = J2e=o'^k.e{s) and where we define the conditional probability mass function W£\k{^) of 
choosing PHY mode £ given that the sensor k is scheduled, and the channel state is equal to s, given by 

L 

wo\kis) 



Wk,0[S) 



we\k{s) 



Wk{S) 

Wk,e{S) 



Cfc.KS), for £ > 0. 



WkiS) 

The terms appearing in the stability constraints can be written as 



E 



^Wk/{S)Ril{Ek/{S)Sk > ai} 



E 



E 



^k{S)^'^(kAS)Ri 



Wk 



[^)^wi\k{^)Rt 



1=0 



(43) 
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At this point, we have reduced the solution of (18 1 to the determination of the conditional probability 
mass function Wk{s)w£\i^{s) of /C,r,^7r given the channel state S = s, where the energy allocation for 
given k,£ and s is deterministically given by ek/{s) = ai/sk- This provides a direct proof of the second 
statement of the lemma. 

In order to prove the tightness of the relaxed problem, we first show that the optimal {t;^|fc(s) is 
"concentrated" with at most two probability masses, at two consecutive indices £,£ + !. For any feasible 

Wk{s)w(,\k{s), let 

Ek{s) 



(44) 



For any fixed s, by construction, the point {Ek{s), fik{s)) is inside the convex hull of the points {ae/sk, Re) 
for £ = 0, . . . , L. Hence, there exists a probability mass function u;^|fc(s) that has only two mass points at 
consecutive indices £{k, s),£{k, s) + 1 for some i{k, s) to be determined below, yielding the same stability 
constraint and a smaller average energy. The situation is shown qualitatively in Fig. [T] The two-points 
probability mass function is constructed as follows: let £{k, s) denote the index in 0, . . . , L such that 
R(>{k,s) < /ifc(s) < Re{k,s)+i- Then, we let 



Rnk,a) + 1 — Ri(k.a) ' 

fJ-k{s) — Ri{k,a) 
Re(k, a) + l — Ri(k,a) ' 





for £ = £{k,s) 
for £ = £{k, s) + 1 
elsewhere. 



(45) 



It can be immediately checked that this probability yields the average energy Ef^{s) given by the intersect 
of the segment of straight line joining the points {ai(^k,s)/sk, Re{k,s)) and {ai(_k,s)+i / Sk, Re{k, s)+i) with 
the horizontal line at level /ifc(s). Since the straight line segment is part of the boundary of the convex 
hull (see Fig. then £"^(8) < Ek{s). Notice also that the union of these straight line segments coincides 
with the function 'Jl{esk) (function of the dummy energy variable e on the energy -rate plane, for fixed 
Sk), where 7l(snr) is the already defined upper concave envelope of /^(snr) = max^{i?^l{snr > a^}}. 
The proof of Lemma |2| is concluded by observing that, for the probability assignment ■W£\i.{s) defined 



in ( [45] ), the objective function and stability constraint terms of the original problem (18 1 can be written 

as 



and as 



E 



E 



Y,MS)Ek{S) 

k 

Wk{S)]l{Ek{S)Sk) 
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R 



{as/sk,R3) 




Fig. 1. Convex-hull argument in the proof of Lemma |2] for any probability assignment achieving the point {Ek{s), iik{s)) (in 
blue) on the energy-rate plane, there exists a two-mass probability assignment achieving the point {Ek{s), jj,k{s)) (in green), 
with Ek{s) < Ek{s). In the example of the figure, this is obtained by the convex combination of the extreme points (ai/s^, Ri) 
and (0,2/ Sk, R2), i.e., in this case we have £(k,s) = 1. 



respectively. Hence, (1 8 1 is equivalent to the problem 



minimize 



subject to 



E 



Y,Wk{S)Ek{^) 

k 

E [wk{S)Ti{Eu{S>)Sk) 



> Xk, VA; = 1,, 
iTw(s) = 1, V s G 



SkEk{s) > snro, V s G R^', k = 1, 



vJkis) > 0, V s G 



k = 1 



, . . . 5 , 



(46) 



given directly in terms of the probability vector function w(s) and of the energy allocation function 



Ek{s). The equivalence of (46 1 with the the relaxed problem (20 1, and therefore the proof of the first 
statement of Lemma |2j is estabUshed by the following general result: 
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Lemma 3: Problem ([20]) yields the same value as the reduced dimensional problem 



mmimize 



E ^Wk{S)ekiS) (47) 

. k 

subject to E[wk{S)]l{ekiS)Sk)]> Xk, yk = l,...,K, 
iTw(s) = 1, V s e 

sA{^) > snro, V s e R^, k = 1, . . . , K, 
Wkis)>0, VsgM^, k = l,...,K, 

where w(s) = {■wi{s), . . . ,wk{s))'^ and e(s) = (ei(s), . . . , ex(s))"'' are a probability and an energy 
allocation vectors, deterministic functions of the channel state. ■ 
Proof: By Lemma[T} we know that it is sufficient to consider deterministic energy allocation functions 
denoted by ek/{s). For any feasible W(s) and eA:/(s) in (20), define Wk{s) = J2e=o''^k/is) and write 



the objective function in (20 1 as 



E 



'^Wk,e{S)ek,£{S) 



kl 



E 



E 



Wfc(S)efc(S) 



(48) 



where efc(s) = l^^'ff ^fc/(^)- Also, the terms in the rate constraints can be upper bounded as 



E 



E 



Wfc(S) y^ ^'!-if? /"(efc,^(S)5fcj 



< E 



Wk 



Wk{S) 



E [wk{S)ji{ek{S)Sk 



(49) 



where we used Jensen's inequality. This shows that the value of problem (47) lower bounds the value of 



problem (20 1. Conversely, problem (47 1 corresponds to a specific feasible choice of W(s) and efc/(s) in 



the original problem (20), in particular, by letting Wk/{s) = Wk{s)/{L + 1) and Sk/is) = efc(s), for all 
i = 0, . . . , L, k = 1, . . . , K and s € . This concludes the proof. ■ 
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Sensor type 


Throughput (kb/s) 


Sp02 


0.01 - 0.1 


Glucose 


0.01 - 0.1 


Blood pressure 


0.01 - 10 


ECG 


10 - 100 (12-bit, 300 Hz, x20) 


EEC 


10 - 200 (6kb/s, x32) 


EMG 


10 - 1500 (16-bit, 8 kHz, x 12) 



TABLE I 

Throughput requirements for medical sensing devices 



Raw Data 








Rate (Mbps) 


Slots Occupied 


No. bits in pay load 


Notation 


2 


1 


464 


2dhl 


2 


3 


2968 


2dh3 


2 


5 


5464 


2dh5 


3 


1 


696 


3dhl 


3 


3 


4448 


3dh3 


3 


5 


8200 


3dh5 



TABLE n 

Payload for each of the enhanced data rate modes for different time slots. The indication xdhy denotes 

AN uncoded TRANSMISSION MODE WITH RAW SPECTRAL EFFICIENCY OF X BIT/S/HZ, AND PAYLOAD SPANNING Y SLOTS. 
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8 10 12 14 16 18 20 22 



SNR = E /N„ (dB) 

Fig. 2. Packet success probability for enhanced data rates EDR2 and EDR3 for all packet lengths under AWGN. 



AK{t) 




Fig. 3. Block diagram of the system under consideration consisting of K sensors with arrival rates Ak{t), each equipped with 
buffer of length Qk{t) at time t G (0, oo), k £ [1, K], where each of the sensors experiences independent fading realizations 
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piecewise linear rate function to 




snr (natural scale) 



Fig. 4. Effective rate function /i(snr), the piecewise constant function (maximum of indicator functions) corresponding to the 
computation of the energy function achievable upper bound $(A) and the piecewise linear function ^(snr) corresponding to the 
computation of the lower bound $(A), for the case of Bluetooth with modes 2dh3 and 3dh3, with snro = 8 dB. In this chart, 
the SNR axis is in linear scale in order to appreciate the actual shape of the curves appearing in the optimization problems. 
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Fig. 5. Functions $(A) and 'E'(A) (shown in natural scale, not in dB) for the case of K = 1, with truncated Ricean channel 
state statistics, and rates corresponding to Fig. |4] 
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Fig. 6. Average sum energy function $(A) versus arrival rate A for different snro values for the Bluetooth-like protocol with 
PHY modes 2dh3 and 3dh3 with K = \ sensors. The corresponding minimum energy function $(A) for an ideal system with 
capacity-achieving codes of rate 2 and 3 bit/s/Hz, and NULL packet SNR requirement snro = dB is given for comparison. 
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Fig. 7. Comparison of round-robin vs. multiuser d5mamic scheduling policy (opportunistic) for a piconet with K = 2 sensors, 
with symmetric arrival rates Ai = A2 = 1 bit/s/Hz, and snro = 8 dB, under different arrival statistics. Setup 1 considers 
qi = 1, <72 = 1, whereas Setup 2 considers q\ = 0.2, = 1. The horizontal line corresponds to the achievable upper bound to 
the minimum energy function $(A). 
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Fig. 8. Comparison of round-robin vs. multiuser dynamic sclieduling policy (opportunistic) with asymmetric arrival rates 
Ai — 0.04 bit/s/Hz, A2 = 1 bit/s/Hz. All other parameters are as in Fig. |7] The horizontal line corresponds to the achievable 
upper bound to the minimum energy function $(A). 
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Buffer (U) Evolution 
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Fig. 9. Snapshot of the evolution of the buffer Q{t), scheduler weight W{t) and scheduled rate for a bursty arrival process 
with A = 0.04 bit/s/Hz and g = 0.1. 
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Fig. 10. Average energy/delay tradeoff achieved by the improved scheduling scheme with adaptive switching to sleeping mode 
and a bursty arrival process with A = 0.04 bit/s/Hz, g = 0.1 and snro = 8 dB, for different r factors. The case t = 10 
corresponds to the classical non-switching policy. 
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Fig. 11. Snapshot of the evolution of the buffers Qk{t), scheduler weights Wk{t) and scheduled rates for K = 2, independent 
bursty arrival processes with Ai = A2 = 0.04 bit/s/Hz and gi = 92 = 0.1. 
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Fig. 12. Average energy/delay tradeoff achieved by tlie improved sclieduling scheme with adaptive switctiing to sleeping mode 
with K = 2, independent bursty arrival processes with Ai = A2 = 0.04 bit/s/Hz, gi = 52 = 0.1 and snro = 8 dB. The case 
r = 10 corresponds to the classical non-switching policy. 



43 




Fig. 13. Average energy/delay tradeoff achieved by the improved scheduUng scheme with adaptive switching to sleeping mode 
for K = 2, independent arrival processes with Ai = 0.04 bit/s/Hz, gi = 0.1, A2 = 1.0 bit/s/Hz and 92 = 1.0 and snro = 8 dB. 



